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ABSTRACT 



regression 
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formulated 



Path analysis, a technique related to multiple 
analysis is used for ascribing causal relationships among 
Path analysis involves the construction of explibitly 
caiisal models and makes the reasoning explicit in the form 
of path diagrams and structural equations. Regression analysis is 
then used to construct path coefficients or beta weights. Several 
assumptions are required by this model of path analysis. In the given 
example; teacher age, teacher sex, teacher training, and class size 
are assumed to influence democratic classroom control directly, and 
also through their influence on teacher orientation towarii task 
accomplishment (which is assumed to influence democratic classrpom 
control directly). There are a number of advantages of path analysis, 
as well as a number of technical and practical problems. Path 
analysis enables evaluators to conduct local decision-oriented 
studies and at the same time to investigate theoretical causal 
mechanisms. However, there are many difficult problems associated 
with the valid use of the technique, and care must be taken in its 
application. (Author/CTM) 
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. ■ ABSTRACT ' 

The Use. of Path Analysis 
in Program Evaluation 



Nick L. Smith 
Stephen L . Murray 

Nor:thwest Regional Educational 



Path Analysis techniques pr(j>yide evaluativeN^esearchers with a 
unique capability for studying the presumed causal relationshijps 
underlying social art^l educational programs. With appropriate lesigns, 
it enables evaluators to conduct local decision-oriented studies while ' 
simultaneously investigating fundamental 'causal mechanisms . In this ^ 
paper we provide a brief overview of Path Analysis ar^d illustrate its 
use in an actual evaluation study. In the concluding pages, we hig,h1ij5fht 
the major strengths and weaknesses of ^using Path Analysis in program 
evaluation. , • 
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THE USE OF PATH ANALYSIS IN PROGRAM EVALUATION 
PATH ANALYSIS': A BASIC DES CRIPTIt)N 

' — r-r- ■ — ' s • ■ - — ' ,.4 _ 

As Rossi and Wright (1977) have recently noted« 

There is almost universal agreement among evaluation 

researchers that the randomized controlled experimeht 

is the ideal mocjel for evaluating the effectiveness of 

a public policy. If there is a- Bible for evaluation, 

the Scriptures have been written by Campbell and Stanley 

(1966) , along with a revised version by Cook and 

Campbell (1973) . The "gospel" of these popular texts 

is that all research designs can be .compared more or 

less unfavorably tfo randomized controlled experiments, 

departures from which are subject to varying combina- 

tions of threats to internal and external validity. (p.* 13) 

It^^ also widely recognized among evaluation researchers, however, tbalj 
randomized controlled experiments c^n rarely be conducted except with 
specialized „types «*Qf treatments or programs. Many conditions, such , as 
the following, have forced evaluators ay/ay from experimentfal and even 
non-experimental approAcl^es: 

• the inability to operat localize treatment variables because 
of their pluralistic and ^political origins; " - 

• difficulty in adequately monitoring, let alone controlling/ 
A the administration of treatment conditions due to their 

frequent complexity and ♦ ambiguity ; 

• difficulty in establishing meaningful control groups s^lnce 
withholding of treatment is frequently seen as illegal, 

. unethical, or discriminatorV ; ' and 

• the inability to spend the amount of time necessary to 
adequately conduct and analyze suitable field experiments 
because of immediate needs for policy information. 

To date, most program evaluation studies have employed quasi- 
experimental cross-sectional studies without randomized control groups. 
Such cross-sectional studies have the advantages of providing fo^; 



J 



1 



\ 



• the relatively efficient Collection of data within a 
fihort time frame/ 

• the study of interrel^ti^i^ships betwqjen variables at one 
point in time; X ^ 

I • the generaliza^ip^ q£ results to populations of ipterest. , ^ 
\ (given proper sampling) ' ^ ^ ' '[ " 

\ • the elimination or cor^tr^^l of some confounding factors; and • 

• " the use of a vast airr^Y analysis methods that have been 

'developed over the ye^^^s ^or use with cross-sectional data. ^ , 

Cross-sectional studied fes^lt in static models, however, that do 
not provide ^ basis for und^r^ta^^ing the structural .Qr cauaal i^elation- 

' ships among the components of the progr^am being evaluated. Althou<gh 
.causality continues to be k ctPnt^Oversial topic in philosophy as w4ll as 

^ in the social sciences (Brqud/ g^^^. , 1^73) , ^it i^'> a pri^^e concern of . - 
not only the practitioners ,but especially the consumers evaluation 
research. ' . . 

' Path Analysis provides a fl^^ible means of addressing the causal 
problems that arise within th^ c^^^text of program e^luation. Whil^%. 
*path analytic techniques have b^e^ designed primarily for non-experimenta; 
data, they can also be applied ^° experimental, cross-sectional, and 
longitudinal data. Although cai^s^i inference is particularly difficult 

^ in non-ef-perimental research, of the Virtues of Path Analysis is - 

that in order for it to be validly applied, the researcher mu^t make 
explicit bot/h the theoretical f^^^ulations of causal relationships 
within the program and any assoc^^ted assumptions. Path Analysis, then, 
provides a means of empirical'lV ^^sting^ the. tenability consistency^ 
of th/e assumed relationships. . forces a sharpening and testing of 
both the logicaL and empirical J^^^is underlying prograirunatic causal 
clai^ms. 

The next secti of this P^P^r provides a brief overview of Path 
Analysis. Following sections contain an application of Path Analysis in 
evaluating an educational pto^r^^ and a more detailed discussion of the 
. advantages and problems of u^i^g Path Analysis in program evaluation studies. 
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Overview of Path/Analysis , ' 

' , Path AY)aly^is originated in genetics wi'th the work of Wright (1921, 

.1934, 195^, 1960a, 1960b) who developed the method as: 

an extension of the us.ual verbal interpretation of 
y ' statistics, not of the statistics themselves. It 
,is usually easy to give a plausible interpret^ation 
of any significant statistic taken by itself. The 
purpose of path analysis is to determine whether a 
proposed set 6f interpretations is consistent 
^ throughout. \ (1960b, p. 44.4) 

Social scientists were introducted t6 Path Anal v's is primarily as a res>alt 
^ of Blalock's (1964-^968a, 1968b, 1971) and Duncan's (1966) use of 
causal nxDdeling in sociology. Land (1969) helped to geneta^ize the • 
method by developing the methodology of Path Analysis from basic defini- 
tions and assumptions ra'ther than from emphasizing the construction of 
fcasic equations within sociological theory. General ' discussions of Path 
Analysis are provided in Duncan (1966), Land (1969), Blalock (1971), 
Werts and Linn (1971), and Spaeth" (1975). Since their introduction. 
Path Analysis techniques have been used in research studies on a wide 
variety of problems including; 

^job performance (Greene, 1973, Lawler, 1968, Wanous , 1974) 
•role perceptions (Miles, 1975) 

aggression (Eron, Huesman, Lefkowitz and Wolder, 1972). t 
life satisfaction (Sears , 1977 ) ^ 

social stratification (Blau and Duncan, 1967) ' 
educational aspirations (Sewell and Shah, 1968) 
educational achievement (Anderson and Evans, 1974) 
teacher characteristics (Anderson and Evans, 1974) 
college environments (Werts, 1967) 

Path Analysis, as most of the other forms of causal modeling, can 
be characterized as : . 

a. relating primarily to the analysis of non-experimental 
data and the absence of laboratory or experimental 
controls ; 

b. employing hypothetical constructs to specify presumed but 
latent variables which, though not always directly 

■ observed, are implied in the relationships with the 
observable variabiles;' and • 

c' utilizing a system:^ orientation reflected iti * tjfjii^use- of / 
sets of interacting relational equations (Gojldberger ^ 
andfDuncan, 1973). • ^ 



Path Analysis involve?^ the con.st r »ict i nn of oxf » I i c i t 1 y formulatpd- 
altern^ative structural (causal) models whicli \n\\)\y d i fff^rfnt, pattc^rriH of 
rolationRhips anfK^nq variables. Path Analysis makfjs tUr ufide r ly i riq 
causal rf>aBoninq explicit £r?(!t.hc? form ol path cLia(M*i"Ui aud 5jL riKjLurci! 
equations. Rcvf r^oss ion ana 1 y.s i j; then ustMl to (n >t/:; t t ik 't "patl^ 
coefficients" (beta weiqht.s) . Models i ru ori.s i st.cMit with the data arf . , 
rejected, while thosf* not rejected a.ro viewed <is f>lau.';iblc (;au!M^ly^ 
patterns to be further st.iAied. Causa'tiion fantiot, he nnamh i (fuous 1 y * 
demonst rrH:ed u.siru) those? t.eclun (piei; , but f;f juir* (MU^a 1 f><ittern;; fjan.be 
rendered a\c3re bf?l i t?v<il)l e than oihtMs. 

Spaeth (iq/S) hcis po ii\t ed" o»it that P<\t if An.i I y j; i f; '4 !; not a sin()le 
statistical procedure: ' [ 

^ ' Instead, i.t Ls a family of ways analyzinq data. The - 

members^ of this family are models def>ictinq the 
^ influr^nce of one sot of variabd(?s on, another* (\k 

Models whlel,! may.be (nvori p'At?h ar\a 1 y t i c: i n terpretat i or\s , and are therefore 
members ef t:h i .s family, include ordin<iry mult iple teqr(-;s ioic, confirma- 
tory factor analysis, c;anoniral analysis, aricJ I wo-st aqe least. s({uarf?.s. 
rt should be eimphasi/ed, t:herefore, that Path Analysis, is not jUst a 
special use of ordinary rec]iv^ssion analysis, thou<7h req roj^s ic!)n analysis 
is used to' compute f>ath coe t* f ir; ient-S . In Path Analysis, mu\ equation ^ 
represents a causal I i r\k^ and not just an enifjiriCcil <issoc iat.ion , whero<is 
in least squares reqresr>iOn, ar/ equation simply repre5?(Uits tlu^ mean cU' 
^he dependent variable as a funcrtion of the independent varfables. 
Least squares reqre^^s i.oi\ l)rocedures tjive inap>pi"0})riate estimates 
whenever the causal equations oSntam ut\observab,le variables (errors 
of meaauretnent) , reciprod^l causation (simultaneity) or omitted variables 
(inadequate control). If r\ono of these conditions exi^rt (cu- at least 
one makesi such an assumption) then least squares re<jrcssion d(K?s qivci 
suitable parameter estimates. ( See- Go Idbe rqor and Duncan, 107 3, lor a 
detailed discussion of this j^oint.) 

The followinq assumptions are made in thf? ust^ c^f Path Analysis. 
These assumptions have to be met to obtain valid results from an 
appliCfition of the technique. ^ 
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1. A clearly defined, Explicitly Hpocifled causal system, which 
includes all relevant variables , is asBumed, 

2. The form of the model muat be correctly specif i^d' with 
yqjriables ordered correctly from the ix>^nt of view of both 
theory fxnd nieafluremont procMul\*res . 

K 'within t\M} structural modrl a chan(jo in one variable is^ 
always a linear funct iori of chanqea In other variables. 



4. 

6. 



Dependent variables arc assumed to be \iricorre lated with 
each otheTri, 



Hypothetical, unmeasured variables are assumed to be continucftfei. 



/ 



Mea.suremenls jaro assumed to hav<? fi . hi qh de<Tiree of reliability 
and validity {low mf?asuromorit orror) . 

The data m\ist meet all multivariate retiroj^sion assumptions 
includinq: 



interval scale measurement , 

' > 

homOscedasticity*, 

relatively low intercorr^lations among causal variables 
used as predictors, - - 

linear and additive effects amonq variables, 

residuals are uncorrelated with a me^u of zero and unit 
variance, ^ ' >< 

fixed effects independent variables. 



Path models may be recursive ( involving only one-way causation) or 
non- rermrsi ve (involving reciprocal causation),. I^'or the sake of clarity 
and simplicity,, this paper deals only with recursive models. ' ^ \ 

^ A path diagram is a graphic display of the order in which variables 
are' assumed to affect one another. Variables in a path diagram are 
either endoge nous or exogenous . Aa endogenous variable -is one which is 
dependent upon other variables in the diagram while exogenous variables 
are those which. affect endogenous variables. Since there'can be more 
than one stage of causation displayed . in a path diaqrim", some endogenous 
variabl^^ may act as exogenous variables for subsequent endogenous 
variables. The initial variables in a diagram, however, are always 
exo^^enous to that-^..3^stem. > . * 

Conventions for,.,drawing path diagrams are described by .Land' (1969). 
Arrows are drawn fr^ ''Variables acting as causes to variables acting as 
effect^. Initial exoge»n6uf5 'variables are linked to one another by curved 
,lines with double arrows'^,. ^'rFo.i example, .suppose one assumes that X is 



caused by both A and B and that one ia ^Qt interested in the ci^usos of A or B*^* 
This would h& represented below in Pigure 1, * ' 




B 

* Pigure simply causal model 

Analysis^ is designed to produce measured of relations^tip between a 
given endogenous variable and each of ^Y\e exogenous variables bn whicih 
it i^ dependent. Thof^e indices ^ called "path coefficients." 
reduction of the effects /^f ^hy exogenous variable into its direct , 
effect^ (direct paths ot^rinf f ^ence ) , and its in direct effect s* (gff^^^c: 
analogous to the effects of antecedent variable as transmitted through 
an intervening varialile) , 'i^ ^ major feature of the^ath Analysis technique- 

The reader i's referred to Land (igei^) for an extensive discussion of 
the principles of p^th Analysis including deriVaticjfis and interpretations ' 
of path coefficients in various types o/.path models. Spaeth (1975) ^ 
provides a detailed compari^^on of the ibgics behind predictive least 
squares models and totally J^^cursiye p^^h tiodefs. 



PA^ni^^yi^ I S : A_N^^ pL I C AT IO N 

Before proceeding to a "lore detailed discussion of the general ^ 
advantages and problems of ^^ing Path Analysis in Program evaluations^ 
a specific example offered here ti belp familiarize the reader with 
the t>asie approach. This example concerns the application of p^th 
Analysis to assess the classroom impact of a teacher training 'workshop. 
(This example was one facet of a more comprehensive evaluation study 
that ^'as reported 1^ Murray gt al. , Note 1 J ^ 
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The .Evaluation Problem 

An Evaluation study was conducted of , an instructional system designed 
to increase the skills of school teachers in systematically carrying, out 
a five-step method of problem solving: ^ (a) identify the\j)roblem, 
'(b) diagnose the problem situation, (c) consider alternative actions, 
(d) try out a plan of action, and (e) adapt the plan. 

Participants are guided through 16 sequential and cumulative training 
units, each consisting,, of a serie? of concept papers, group discussions, 
and, exercises. Thte materials we^e designed to develop participant knowl- 
edge and participant ability to use the problem solving process in 
identifying artd diagnosing classroom, school,' and peer-related problems. 

The instructional strategy of the system is based on a pattern of 
repeated diagnoses carried out in small training groups of three or 
six persons. The knowledge gained through this process provides the basis 
for selecting and designing action plans to solve the identified problems. 
A simulation exercise pr<^vides opportunities for participants to practice 
skills in training groups and to learn to observe and improve their 
teamwork behaviors in a workshop setting. 

Thirty-eight fourth, fifth, and sixth grade teachers comprised the 
treatment gVoup that attended instructional workshops in one of two 
locations. Data were also gatheMd from another 24 fourth, fifth, and 
sixth grade teachers who constitAited a non-randomized control group. 
Analysis of a background questionnaire revealed that the treatment group 
and the control group were similar in terms of proportion of males to 
females, age', years of teaching experience, and reasons for attending 
the workshop. However, a somewhat higher proportion of control group 
members had obtained a master's degree. 

One purpose of this evaluation study was to investigate the impact^ 
of workshop training on classroom activities. The pattern of rel^ion- 
ships among outcome measures was examined through the use of Path Analysis 

Evaluating the impact of teacher training on students requires the 
definition of a sequence of outcome measures which allow the training 
activities tq be linked with student outcomes. >| When there are wellr 
defined student objectives, evaluating the impAct of teacher training 
is straightforward. if ^tudent objectives are missing, as they were for 
' this system, the evaluator must use what information is available 

to infer a sequence of t?raining effects. ' 



Such an inferred sequence of effects can be portrayed in a path 
diagram and Path Analysis can be used to test the inferred causal 
relationships. Representing treatment effects in a path diagram also 
helps identify "weak links" irf the chain of effects expected to result 
from training. 

One of the path diagrams used to assess classroom impact in this 
evaluation studjy is presented on the following" page . ^ Teaqher Age, 
Teacher Sex, Class Size and Training are assumed to influence Democratic ^ 
Classroom Control both directly and through their influence on Teacher 
Orientation Toward Task Acc6mplishment , which is assumed to influence 
Democratic Classroom Control directly. 

These variables were selected for this path analysis on the basis 
of their compatibility with the overall rationale of the instructional 
system being evaluated. Teacher Age, Teacher Sex, Clas^ Size and 
Training (a dummy variable where treatment group = 1 and control 
group = 0) were all assumed to be, reliably measured. 

Teacher Orientation Toward Task Accomplishment, which was administered 
prior to and immediately following the workshop, is one scale from a self- 
report measure of teacher orientation toward problem solving. In the 
questionnaire, respondents are presented with a variety of realistic problem 
situations and asked to estimate the probability of their behaving or reacting 
in a mariner consistent with the view of problem solving advocated in the 

instructional materials. Responses to item's are ma;de in a five-point multiple 

\ 

choice ^cale identical to that in the following sample item:) 

Suppose something has gone wrong in your school — Something that 
affects everyone and has everyone upset. What are the chances 
that you would remain quiet and wait for others to analyze 
the problem? 

1. Almost none (less than a 10 percent chance) 

2. Maybe (about a 2 5 percent chance) 

3. Possibly (about a 50 percent chance) 

4. Almost always (about a 75 percent chance) 

5. Definitely (greater than a 90 percent chance) 

A split-half reliabilty of . 71 , -"corrected with the Spearman Brown Prophec 
formula, was obtained for Teacher Orientation Toward Task Accomplishment 
based on a sample of 87 teachers. A test-retest reliability of .61 was 
obtained on this scale for the same group of 87 teachers. Since the 





Figure 2, 
*P ^ .01 



Path diagram and standardized partial regression coefficients for the evaluation of t^diC^^^ 
training in terms of its impact on the level of democratic classroorti control 



teat-retest reliability was based* upon pretest-postt^st . admiriistrations 
designed to assess training effects, the test-retest reliabilities 
should be interpreted as conservative ^i^timates of stability. ' 

Democratic Classroom Control is one scale on the Student Activities 
Questionnaire (Ellison, Callner, Fox, and Taylor, Note 2) , a multiple- 
choice questionnaire designed to measure various aspects of classroom 
climate. It was administered to the treatment groiip* after the first week . 
of workshop, instruction and again after the completion of training three 
months later. Similar data were collected from the control group, although 
due to scheduling difficulties, ohly two months elapsed between the pre- and 
posttest administrations. This scale is a measure of student input in^o. t 
classroom decision making, planning of individual activities, and enforcement 
of rules. Students with high scores on this scale report that they are 
allowed frequent input through discussions and planning activities ctnd 
that decisions are made through the joint effort of' teacher and students. 
This scale was selected because of its compatibility with the "group 
problem-solving" orientation of the instructional system and its 
compatibility with information on how past trainees had used the training 
in their classrooms. ' 

Intraclass correlations of .79 on the pretest (based on., 84 -classrooms, 
1,4^9 students), and .72 on the posttest (based on 73 classrooms, 1,213 
students) were obtained for Democratic Classroom Control. (The intraclass 
correlation is a function of within- group and between- group variation of 
student responses and constitutes a measure of consistency or reliability 
using the classroom as the unit of analysis.) A test-retest reliability 
of .45 was also obtained (based on 73 classrooms, 1,213 students) but must 
be considered as a co'nservative estimate because of the intervening treatment. 



The Path Model - , 

Two recursive structural equations correspond to the path diagram 
represented in Figure 2. 

Z=P Z-fP .Z-fP^Z-f^ + P^ Z 

5 * 5,1 1 5,2 2 5,3 3 5,4 4 5, a a 

Z + P Z -f P Z + P + P. + P_ _Z_ + P^ , Z^ 

6 6,1 1 6,2 2 6,3 3 6,4 4 6,5 5 6,b b 
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^ The first equation repres^rits the influence of the exogenous * ' 

variables ^ori Teacher Orientation Toward T^sk Accomplishment. By solving^ 
t^is linear regression equation it is possible to make estimates of ^ 
the direct effects (path coefficients) of the prior variables on this 
endogenous variable. While these path coefficients do not in themselves 
indicate causality they can be used to assess whether or not the data are 
consistent with the prior causal model. Tal;|le^ 1 presents' the stindardized 
partial regression coefficients or^ath coefficients for the variables 
in Figure 2 and the multiple correlation obtained for explaining post- * 
training Teacher] Orientation Toward Task Accomplishment. 



Table 1 



Multiple Correlation and Standardized Partial Regression 
Coefmcients for Explaining Posttraining Teacher 
Orientation "Joward Task Accomolishment^ 



Exogenous 
Variable 


Multiple 
Correlation 


Standardized 
Partial Regression 
Coefficient 


0 

p~Value 


Teacher Age 


.46 


-.50 


.01 


Teacher Sex 




-.23 


^.19 


Clas5 Size 




.21 


.23 


Training 




-.16 


.37 



Only subjects for whom there were complete data were used in this 
analysis. (Treatment Teachers N=26, Control Teachers N=10J 

-ft 

It is apparent ^from examining Table 1 that the training did not haVe / 
any direct effect on Teacher Orientation Toward the Task Accomplishment " 
as the corresponding coefficient was -.16. The multiple correlation 
resulting from regressing posttraining Teacher Orientation Toward. Task 
Accomplishment on the four variables in the path model was .46. The 
only significant path coefficient was for Teacher Age (p :s .01), 
indicating th^^t younger teachers saw themselves as haying stronger 
orientations toward problem solving. 
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The* second structural equation: • 

represents the influences of all five variables on the classroom impact 
variable, Demoeratic Classroom Control'. Table 2 includes the multiple 
correlation and t^e path coefficients indicating the relationships between 
each of the exogenous' variables and the level of Democratic Classroom Control, 



Table' 2 ^ 

Multiple Correlation and Standardized Partial Regression 
Coefficients for Explaining Posttraining 
Level of Democratic Classroom Control 







Standardized 




' Exogenous 
^^^^^.J/ariable 


V 

< Multiple* 
(^relation 


Partial Regression 
Coefficient 


p-Value 


Teacher Age^^^^^\^ 


.57 


.24 


« 

.21 


J^Teacher Sex 




.22 


.20 


Class Si2:e 






.24 


Training 




-.02 


.93 • 


Posttraining Teacher 




.49 




Orientation Toward 


>^ 






Task Accomplishment 







^Only subjects for whom there were ' complete data were used in this 
analysis. (Treatment Classrooms N=26, Students N=650; Control 
■ Classrooms N=10, Students N=281) _ . 

The multiple correlation of .57 is significant (p^.03) and indicates 
that the model explains 32.5 percent of the variation in the classroom 
impact variable. The path coefficients (standardized partial regression 
coefficients) indicate that the data supported the hypothesis that teacher 
problem' orientation (Teacher Orientation Toward Task Accomplishment) 
influenced classroom climate as perceived by students (Democratic 
Classro^ control). However, there was no evidence thkt training had 
any impact on classroom climate. 

12 . • ' ' , . 



In summary, the analysis of the model represented in Figure 2 
suggests that: 

• younger teachers saw themselves as having stronger orientations 
towards task accomplishment; 

• post-training teacher orientation towards task accomplishment 
influenced subsequent classroom climate as perceived by 

students; but \ 

m training had no influence on either task orientation or 

classroom climate. ' . 

An analysis of covariance, which controlled for group pretest 
differences r had been conducted prior to the causal analysis and no 
significant training' effect had been found. By using Path Ai^alysis with 
the non- randomized control group, possible to not only test for 

direct and indirect training effects, but to investigate the causal 5 
relationships which were assumed to lead to the desired classroom, impact , 
The caiisal model supported by the data would look J^ike Figure 2 without 
the two training arrows, 

HaviiVg briefly illustrated one means of using Path Analysis in an 
evaluation 'study, a more complete discussion of the general advantages 
and problems associated with the use of the technique in program, evaluation 
is now ^afJpropriate . 

,\ g^:TH _ANALYSIS: A N^H^lLL^AT^ TECHNIQUE 

Path Analysis is a powerful technique that offers exceptional 
capabilities to the evaluative researcher. There are major difficulties, 
however, in application that limit its use in program evaluation 

work. The strengths and problems of Path Analysis are discussed more 
fully here in triis final section of the paper. 

Strengths oj ^ ^^th Ana l ysis 

Path Analysis provides the program evaluator with unique .advantages 
and opportunities not available with most other techniques. Several 
of these special advantages are highlighted in the following: 



Provides a means for modeling of complex programs . Path AnalyS*is ^ 
provides a means. of incorporating recursive and' reciprocal causation and * 
unobservable variables into evaluative studies of programs. The 
resultant analytic models are a more faithful representation of the 
dynamic reality of the programs themselves. With this technique, 
programs will not need to be/ simplified "beyond recognition" just in 
order to be- evaluated. , ,^ 

Forces consideration of alternative models . Path Analysis requires 
the explicit specification of presumed causal relationships and forces the 
researcher to consider several alternative causal models. ^, (In the example 
presented above, twelve alternative causal models were identified and 
considered in the course of the study-) These competing* models can then 
be' tested simultaneously using not only correlational information, but other 
observational and experimental data. The technique, therefore, broadens the - 
realm of inquiry and helps forestall the "pet theory" and "objectives driven" 
biases evident in much evaluative research. Path Analysis provides one means 
of preserving an evaluator's objective detachment by ejriabling him or her to 
simultaneously investigate multiple working hypotheses (Chamberlin, 1965). 

Enables the study of both direct and indirect effects . Path Analysis 

enables the researdher to study both direct and indi^rect effects on 

dependent variables as well as to analyze correlations between variables 

into various components, depending on the causal .models postulated. Path 

analytic techniques provide a means of distinguishing between (1) compo- 

] 

nents due to the mediated effects of one variable through another 
variable, (2) components which are due to correlations between various 
causes in the system, and (3) spurious components which are *due to one 
variable having a common cause with another variable in the model. The 
identification of indirect effects is crucial both when evaluating program 
impact and when making program revisions. : 

Permits incremental revision of the structural model . If a path model 
is overidentified (that is, the information from the observable variables 
provides more than enough information to determine the structural parameters, 
as when certain path coefficients are hypothesized to equal zero) , then it is 
possible to employ this information to revise the model. As a part of 



N 



14 



the evaluative study, special testing procedures can then be employed 
which indicate what parts of the model need Revision . These procedures 
allow the evaluator not o^^^ to test the tenability of the overall 
models but to revise Se^ti^^^s of the models all v^?ithin the context of 
one evaluative study. (See^ for example, Pedhazur, 1975, and Goldberg 
and Duncan, 1973.) ^ > 

Enables the estim atg_g ^the severi ty of ^ the v a rious bias es . Sources 
of bias and the means o( ^^^imating their magnitude have been extensively 
studied for traditional le^^t squares methods. Since Path Analysis is 
.based on these metjj^ods, it possible to identify ^"d measure the sources 
of bias in path models to ^ lUuch greater extent than wit;^ most other 
techniques in evaluative r^^^arch- These sources of bias are identified 
in the lections below cc^^^^^ed with problems in Path Analysis. 

Can be used on a hej^rj^^ic^ logi cal , or statistical le^^ el_. As 
illustrated above. Path Analysis was designed primarily as a logical and 
statistical approach ^ot^ testing hypothesized causal models^ Path 
diagrams can be used, hc^we^^r, as a purely heuristic device for charting 
presumed causal relatior^^- "fhe explication of causal relations can be 
useful in planning ev^lU^ti^n studies (whether they are to be experi- 
mental or non-experim^nt^^l nature) and in studying the logical 
consistency of the implicit "theories in use" which guide program development 
and relate program actii^it^^s to program goals, r 

Permits developin ^n^jj>^st ing__of innovative ^ograms . xhe development 
of innovative programs i-s ^'^metimes based on expli^^^^ rationales whicTh are 
contrary to standard pr^^t^-O^ and which have little substantiation in 
past research. Pat|i An^ly^"^s provides a jneans of explicitly delineating ' 
the rationales of the^e innovative models and of testing their tenability 
in their current develo^n^ei^^al forms. 

Provides greater c^pn^H^ity ^and generalizabili^Y to eva^iuation findings . 
Path analytic technique^ P^^vide a means of studying the basic causal 
relationships within ^o<^i^-^ and educational programs. By including 
treatment and comparisoJ^ ^^'^Ups in path models, it is possible to 
conduct comparative evaJ-^^^^on studies helpful to decision makers and at 
the same time to conduc*^ i'^^^arch studies of bas ic programmatic m'fechanisms. 
Such an approach provides ^^th local decision-making information, and the 
more basic programmatic information that can be accumulated and 
generalized across succ^^<^^^g evaluation studies. 



Problems with Path Analysis , 

As Feldman (1975) points out - : 

« Like most advances, however, causal-correlational 
analysis is not an unmixed ^lessing. To be used 
properly, njany issues must dK,4j?^1^ with in each 
^ study, on both statistical and theoretical levels. 
Failure to consider these issues leads to serious 
restrictions on the inferences that may be drawn and • 
on the theoretical relevance of a given set of results. 
. \^ (p. 663) 

jSome of the technical problems associated with,, the use of path analysis 
j/ procedures are presented below, followed by ai^discus sion of the more 
pragmatic problems. The reader is referred toVthe cited publications 
for fuller discussions of the technical problems which follow: 

The Problem of Congruent versus Incongruent Influence 

' In a path diagram, if variable A appears to be causing changes 

. in variable B in a congruent direction, that is, A is increasing 
the agreement between A and B scores, it could be instead that B 
is causing changes in A in an incongruent direction / that is , B 
is decreasing the agreement between A and B scores. Since the 
Pyith Analysis methoci alone does not specify which of these 
interpretations is accurate, there is an* inherent ambiguity in 
t^he interpretation of the findings (see Rozelle and Campbell , 
1969, Feldman, 1975) . " 



\ 



O 16 



The Influence of Causal Interval on the Structural Relati-pns 

In some cases the structural relations between variables in 
a path model differ depending on the causaL interval used. For 
example. Sears (1977) found that in studying life satisf act^iona 
over a 50~year life cycle, the highest predictive value of any 
variable is for variables measured at the succeeding decade. 
Thereafter, a variable's direct prediqtive value diminishes with 
time. Similarly, Porter et al , (1974) found systematic changes 
over Ame in tne correlation. between job attit;udes and turnover. 
Since structural relations can, therefore , differ depending on 
the causal in/^erval used^ a theoretical justification is roqaired 
for the use of any given causal interval in a st\idy. (See 
Feldman, 1975.) 

The F^'r oble m of Necessity and Sufficiency 

In determining whether or not A causes B, it is necessary 
to determine whether A is a necessary or sufficient cause cf B, 
or both, and whether it is the presence or absence of A that 
exerts the causal influence. Although the design of the data 
collection may make such a determination possible, the mathema- 
tics of Path Analysis per se do not. (See Howard and Kraiise, 
1970, Feldman, 1975. ) 



EKLC 



The Problem of gtates versus Changes in Stages ^ • 

Both causes and effects may be states (static) or changes 
in stat^ (dynamic)-. fWith continuous \/ariables there are four 
different causal patterns possible: - 

Stat ic- Stat ic : A certain j^tate of A causes a 
certain state of B;^ . * ' . - - 

static-dynamic: A certain state of A causes a . *" 

certain change in the 'state of B; 

dynamic-static: A certain change in the^ state of, „ 
A causes a* certain state m B; 

dynamic-dynamic: A certain change in thq state of ^' 
A causes a certain change in the st'ate of B. 

Finding that one pattern exists does not necessarily eliminate 
the other three. (See Ftoward and Krause, 1970,. -b^eldman, 1^)7S) . 
In program evaluation, this problem is related to the use of ' * " 
posttest scores (static) or change scores (dynamic) in assessing 
program impact -on, dependent variables . 

The Problem o f Mu l t icol 1 ineari ty ^ 

When the. exogenous variables in a causal model are interrelated 
(multicollinea'rity) , it is not possible to unambiguously deter- 
mine what proportion of the variance in the endogenous variable 
is accounted for by each of the exogenous variables. If the \ 
exogenous variables are highly in,t;ercor related , then f^l-iqht 
changes in the patterns of intercorrelations (due perhaps to 
measurement, specification or sampling errc^irs) may result in 
substantial changes i^ the magn i tudes Vf ^ the regression 
coefficients. Mul ticollinearity often arises When multiple * 
indi^ators%^re used in the regression estimatof^ for tho variables 
of prime interest. (See Pedhazvir, 197S.) 

The Pro blem of Measurement Errors 

One of. the assumptions of Path Analysis Is that the " measurements 
have perfect )^liability ancf validity, i . e^^ , ,are free of error. 
The greater the errors of measurement^ however, the more questionable 
the interp-retatlon of the relative magfiitudes of the path coefficient 
in the structural equations! (See PedHa/.ur, 1975, for a long list 
of references. ) : i. 

The Pro b lem of S pe ^i f i'cat ion llrror s ^ • ^ 

\Specif ication errors result from the use of a wrong or inappropriate 
model, svich as ^when r^]>vant exogenous variables are omitted from 
the. regression equation, when irrelevant variables are included, 
.of when linear or additive models are used hut are i napi^ropri ate . 
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Althotigh specification errors can-be controlled in e;>cperimental 
research throvigh randomizat ion , they cannot be controlled in non- 
. experimental research and the subsequent addition or deletion^of 
variables to the path model may substantially alter the magnitudes or 
signs of the regression coe-f f icients . Only clear, stronj^ theoretical 
formulations of the path models can forestall serious specification 
errors- (See Spaeth (1975) for an extensive discussion; also Pedhazur, 
1975.) 

The Problems/(3f Nonlinearity and Nonaddi tivi^ty 

Path Analysis assumes both linearity and additivity.* Though in some 
cases non-linearity ar\d non-addi t ivi ty (interaction effects) can, be 
handled through the use of dummy variables and polynomial regression, 
the interpretation^of the regression coe f f ic ien,ts in these cases remains 
ambiguous and problematic. Though Path /Vnalysis a^umes linear additive 
models, such models may be too simplistic for so^ji^program evaluation 
appi icatiojAs. ( See 'Pedhazur , 197S . ) * ' ' 

Becau's^* standard rocjression >(6quations contain only observable variables, 
the values of equation parameters can be directly deduced from the 
observable variables. By contrast, the structural equations in Path 
Analysis may contain unobseryable variables and^the problem arises 
to what teclmiques to use to uniquel;/ diviuce the values ot all the 
structural paramettvrs (some of which may be unobservable) from just the 
observa'ble variables. The identification of parameter values under 
reciprocal causation presents a problem, while models that assume 
one-way causation and nori-c:orrt^ iat ion of residual variables are 
completely identifiable and so do not have this; pvoblem. ( Sco ( w d dh(M (J(m 
ai\d Duncan/ V) 7 ^ and hand, PM.n) . 

In addition to t lir .ihovo ttM'hnical |u Umu.'; , t htM <n some prwMnuitii- 
probhMus which may [ • ri '( M urlt^ t u:;f> ol IMth Atuilyros m many fM\u|ran\ 
eva luat i c >r. st ud u v ; , 

Time and J^^'J^i^J^--!' Kegui remei\t.s ^ 

Wlien Path AjVi lysis is used in evaluations to t^ssess treatmer\t 
effects over spt^cific- eausal intin'vals, t'hen data must be 
collected cmi ""mul ti pie variables <vt several points in time. 
Because of the complex medelir\c] and additional data coilecticMi, 
Path' Anal ysi-s is likely to be more expensive and t ime consuming 
thai\ simple" pi t»-p(^st prorednres . 

A Priori; toowl e c J5^t*JJHL0l\'^l^A 

The proper use of PatK Analysis requires tl\at tl\e e val uator be 
able te a t>^rj^)j:_i s|XH:iFy all relevai\t variables and their order / 
and relat ior\ship i'l^ one ot more causal mod(»ls since a fivo- 
variable systt^m ean l^e portrayed i r\ l,()4M,S7h possil)le ooiU i gdrat i ons 
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(Young, 1977), P^^h ^alysig may not be appropriate; therefore, 
for caeVelopmental innovative educational programs where' the 
presumed causal relationships are largely unknown or are ^ 
unidentifiable clue to continual shifts in program rationale. 

^on and Use • . 

^ Pat'h models With f^ur or more variables become increasingly 
complex and problematic to vise. It may be that models which 
appropriately represent most programs will be simply tdb. complex 
and the calculation . of coef f ^^^lents and their interpretatiori 
will be too tedious to make the technique of practical value 
J.n many applied evaluation studies. - ' 

gon c^lusion x 

Path Analysis provides evaluative researchers with a unique capability 
for studying the' presUfped causal relationships underlying social and 
educational programs, With appropriate designs, it enables evaluators 
to conduct l,ocaX decision-oriented studies and at the same time to 
investigate ttiore fundamental causal mechanisms--an exc^elie^t means of 
combining fie^^ research with field service. 

There are many difficult problems associatied with the valid use of 
the technique, however/ and Appropriate care must be taken in its ' 
application. remair^^ to be seen just how useful Path Analysis will 

bo in a variety of appi^^d evaluation settings. However, it appears 
to be a promising ^ipproach for program .evaluation which should now be 
actively tested throu^^ thoughtful .'Use, 
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